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ABSTRACT 


The  assessment  of  uncertainties  In  component  costs,  a  method  of  com¬ 
bining  these  uncertainties  for  determining  the  total  cost  uncertainty,  and 
a  method  of  presentation  for  risk  analysis  results  are  discussed  In  this 
paper.  An  extension  of  the  method  of  statistical  risk  analysis  which  uses 
the  Welbul  distribution  and  the  method  of  moments  Is  developed  for  Incor¬ 
porating  covariance  between  component  costs.  A  computer  program  Is  given 
for  Implementing  the  results. 


I.  Introduction 


When  estimates  and  objectives  are  being  established  for  contract 
negotiations,  numerous  sources  of  information  are  available  and  must  be 
sensitized  by  the  persons  responsible  for  preparing  a  pre-negotiation 
briefing.  Within  ASD  these  persons  are  assigned  to  the  Directorate  of 
Pricing  and  are  referred  to  as  price  analysts.  The  price  analyst  has  the 
responsibility  of  determining  and  negotiating  a  fair  and  reasonable  price 
for  a  contract. 

The  information  available  to  the  price  analyst  is  generally  point  esti¬ 
mates  of  components  which  directly  affect  the  total  cost  (e.g.,  material 
cost,  overheads,  labor  hours,  etc.).  These  point  estimates  for  components 
are  generally  derived  by  engineering,  cost,  or  price  analysis.  By  combining 
these  point  estimates  for  components,  one  can  derive  a  point  estimate  for 
the  total  cost  of  the  contract. 

Seldom  are  the  component  costs  known  with  certainty  unless  there  are 
firm  purchase  orders,  negotiated  overhead  rates,  fixed  wage  rates,  etc. 

The  components  which  are  not  fixed  at  the  time  of  negotiations  are  the 
components  for  which  a  point  estimate  is  not  sufficient  unless  one  has  a 
crystal  ball.  The  components  not  fixed  will  be  referred  to  as  uncertain 
components.^  Risk  analysis  Is  a  procedure  for  taking  Information  about  the 
uncertain  components  and  reflecting  how  much  uncertainty  exists  in  the  total 
cost.  An  uncertain  component  such  as  the  manufacturing  labor  hours  is  often 
referred  to  as  random.  This  is  not  to  say  that  management  cannot  control 
labor  hours,  but  simply  impl-es  that  under  good  management  the  specific 
’.mount  of  manufacturing  labor  hours  required  cannot  be  determined 
specifically;  therefore,  there  is  still  some  uncertainty  or  randomness. 

Risk  analysis  Is  basically  a  three-phased  procedure.  First,  the 
contract  must  be  analyzed  to  determin  .  where  uncertainties  exist  and  to 


^Technically  many  authors  differentiate  between  risk  and  uncertainty, 
but  the  two  terms  will  be  used  interchangeably  in  this  paper. 
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determine  the  magnitude  of  the  uncertainty  for  each  component.  Second,  the 
component  uncertainties  must  be  combined  to  reflect  the  uncertainty  in  the 
total  cost.  Third,  the  resulting  total  cost  uncertainty  must  be  used  and 
presented  in  a  way  that  aids  In  the  decision-making  and  understanding  of  the 
contract  under  consideration. 

The  second  phase  of  the  risk  analysis  is  the  link  between  component 
uncertainty  and  total  cost  uncertainty.  This  phase  Is  often  considered  to  be 
the  risk  and  analysis;  however,  the  first  and  third  phases  are  the  most 
Important  In  Implementation.  The  second  phase  has  been  approached  many  dif¬ 
ferent  ways  making  different  assumptions  and  using  different  methodologies 
tl,  2,  3,  6,  7,  10J,  The  methodology  used  In  this  paper  Is  given  In 
Appendix  I.  The  first  part  of  the  appendix  Is  based  on  results  presented  In 
B>J.  The  last  part  Is  original  work  which  appears  here  for  the  first  time. 
Section  II  contains  the  assumptions  made,  the  Information  concerning  com¬ 
ponents  required,  and  the  results  provided  by  the  second  phase  of  the  risk 
analysis.  Section  III  contains  an  explanation  of  how  the  resulting  total 
cost  uncertainty  can  be  used  and  how  It  can  be  presented  In  order  to  provide 
the  decision-maker  with  valuable  Information.  Section  IV  contains  a 
description  of  how  the  price  analyst  can  assess  the  uncertainty  In  the 
components.  Section  V  provides  an  example  of  the  use  of  a  computer  program 
designed  to  perform  the  calculations  to  combine  the  component  uncertainties 
Into  the  total  cost  uncertainty.  In  the  last  section,  several  recommen¬ 
dations  are  maoe  concerning  Improving  the  usefulness  of  risk  analysis. 


4 


II,  Statistical  Risk  Analysis 


In  order  to  discuss  the  component  uncertainty  and  total  cost  uncer¬ 
tainty,  we  use  probability  distributions.  The  area  under  a  probability 
distribution  represents  a  probability  of  an  uncertain  quantity  having  a 
value  between  two  points.  For  Instance,  in  Figure  1,  the  probability 
(p(c) )  of  the  uncertain  component  cost  being  between  $1,000  and  $2,000 
is  given  by  the  amount  of  area  shaded. 


P(c) 


Figure  1 

In  order  to  describe  component  uncertainty  and  total  cost  uncertainty,  the 
Weibul  distribution  has  been  chosen.  The  term  "Weibul  distribution"  is  used 
to  describe  characteristics  of  the  probability  distributions.  For  instance, 
the  Weibul  distribution  can  have  many  different  shapes.  (See  Figure  2). 
There  Is  a  lower  limit  on  component  costs  but  no  upper  limit.  By  no  upper 
limit  we  mean  that  the  curve  Is  asymptotic  to  the  axis.  The  probability  of 
extremely  large  over-runs  is,  however,  approximately  zero.  The  skewness  of 
the  Weibul  distribution  is  a  desirable  characteristic  for  describing  cost. 


W(c) 


Figure  2 
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The  price  analyst  must  supply  the  information  necessary  to  choose  the 
appropriate  Weibul  distribution.  The  Information  required  is  three  esti¬ 
mates  of  the  component.  First,  the  price  analyst  must  estimate  the 
component’s  most  likely  value.  This  is  the  value  which  has  the  highest 
probability  of  occurring.  Second,  the  analyst  must  estimate  for  the  com¬ 
ponent  a  value  for  which  there  Is  only  a  one  percent  chance  of  being  less 
than  that  value.  In  other  words,  under  the  best  circumstances,  what  would 
the  component  cost  actually  be?  The  third  estimate  is  the  high  value  for 
the  component,  one  which  has  a  one  percent  chance  of  being  exceeded.  In 
other  words,  under  the  worst  circumstances  what  would  the  component  cost 
actually  be?  The  three  points  are  denoted  ML,  L,  and  H  respectively.  The 
three  points  and  a  resulting  Weibul  distribution  are  shown  in  Figure  3. 


w(c) 


Figure  3 

Naturally,  a  different  L,  ML,  and  H  would  give  a  different  shape  to  the 
distribution  for  the  component  cost. 

The  components  for  which  the  analyst  must  supply  the  L,  ML,  and  H  are 
basically  the  same  as  those  used  in  the  00  Form  633.  They  are: 

Material  Cost 

Material  Overhead  (not  based  on  Material  Cost) 

Material  Overhead  Rate 
Interdlvisional  Transfer  Cost 
Engineering  Hours 
Engineering  Wage  Rate 

Engineering  Overhead  (not  based  on  Engineering  Cost) 

Engineering  Overhead  Rate 
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Manufacturing  Hours 
Manufacturing  Wage  Rate 

Manufacturing  Overhead  (not  based  on  Manufacturing  Cost) 

Manufacturing  Overhead  Rate 
Other  Cost 

General  and  Administrative  (G&A)  Expenses 
Other  Cost  with  no  G&A  Expenses 

If  a  component  is  known  with  certainty,  then  L  *  ML  *  H.  Section  4  contains 
information  which  should  be  useful  to  the  price  analyst  in  determining  the 
L,  ML,  and  H  for  each  component. 

By  putting  the  three  estimates  for  each  component  into  the  computer 
model  described  later,  the  distribution  for  the  total  cost  uncertainty  is 
determined.  That  is,  the  probability  of  exceeding  different  values  is 
printed.  These  probability  statements  are  made  using  a  Weibul  distribution 
for  the  total  cost.  The  computer  program  takes  the  information  supplied  by 
the  analyst  for  the  components  and  using  the  methodology  described  in 
Appendix  I,  determines  the  best  Weibul  distribution  for  the  total  cost 
uncertainty. 

The  preceding  estimates  are  used  when  the  analyst  is  asked  to  assess 
each  component  independently.  But  quite  often  when  one  assesses  the  uncer¬ 
tainty  for  different  components  (e.g.,  the  amount  of  material  and  the  amount 
of  manufacturing  labor),  there  is  a  common  underlying  reason  for  this 
uncertainty.  This  is  called  a  covariance  between  the  components.  The  model 
being  used  allows  the  component  uncertainty  to  be  broken  into  two  parts. 

The  first  part  of  the  uncertainty  for  a  component  is  independent  of  events 
which  affect  other  components.  The  second  part  of  the  uncertainty  in  each 
component  is  dependent  on  a  common  set  of  events.  For  instance,  part  of  the 
uncertainty  concerning  the  amount  of  material  and  manufacturing  labor  hours 
may  be  dependent  on  the  amount  of  rework.  Therefore,  material  cost  and 
labor  hours  would  not  be  independent.  To  provide  this  information  to  the 
model  requires  the  price  analyst  to  assess  the  portion  of  the  uncertainty  in 
each  component  between  the  Low  and  High  which  is  attributable  to  the  same 
influences. 
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If  one  of  the  components  is  independent,  then  the  portion  of  the 
uncertainty  attributable  to  common  factors  should  be  zero.  If  the  effects 
are  In  different  directions  (one  positive  and  the  other  negative)  this  can 
be  reflected  by  using  a  negative  proportion.  Again  assistance  in  assessing 
the  amount  of  covariance  is  presented  in  Section  IV. 

The  price  analyst  is  asked  to  assess  the  amount  of  dependence  between 
the  set  of  components  listed  below: 

Material  Cost 

Material  Overhead  (not  based  on  Material  Cost) 

Interdlvlsional  Transfer  Cost 

Engineering  Hours 

Engineering  Overhead  (not  based  on  Engineering  Cost) 

Manufacturing  Hours 

Manufacturing  Overhead  (not  based  on  Manufacturing  Cost) 

Other  Cost 

Other  Cost  with  no  G&A  Expenses 

It  should  be  observed  that  the  covariance  between  the  components  is  a 
function  of  one  set  of  conmon  factors  or  events.  This  single  set  of  factors 
Is  assumed  to  cause  the  specific  proportion  of  variation. 

In  sunmary,  the  assumptions  made  in  the  statistical  risk  analysis  are: 

1.  Component  uncertainty  can  be  represented  using  a  Welbul 
distribution.  This  assumption  Is  based  on  what  most  analysts  feel 
Is  a  reasonable  expression  for  the  behavior  of  cost  uncertainties. 

2.  Total  cost  uncertainty  can  be  represented  using  a  Weibul 
distribution.  This  assumption  Is  based  on  the  same  reasoning  as  above 
plus  the  fact  that  the  Welbul  chosen  to  represent  the  total  cost  will 
have  the  correct  first  three  moments  (l.e.,  mean,  variance,  and  skewness). 

3.  The  dependence  between  components'  uncertainties  is  related  to  a 
conmon  set  of  Influences  or  factors. 

Naturally,  the  results  of  the  risk  analysis  are  only  as  good  as  the  Information 
supplied  by  the  analyst.  It  Is  the  opinion  of  the  author  that  these  assump¬ 
tions  are  Intuitively  reasonable  and  represent  the  current  state  of  the  art. 
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III.  Results,  Uses,  and  Presentation 


As  with  any  mathematical  or  statistical  technique,  the  purpose  of  risk 
analysis  is  to  supply  information  to  a  decision  maker.  The  forms  of  this 
information  and  the  interpretation  are  critical  in  risk  analysis.  Its  use 
must  be  considered  as  only  one  input  into  development  of  a  negotiation 
objective.  The  overall  business  strategy  considers  many  factors.  The  risk 
analysis  should  be  performed  in  an  impartial,  objective  manner  without 
regard  to  gaming,  political  climate,  etc..  Analysts  should  prepare  and/or 
present  analyses  based  on  their  best  judgment  of  the  uncertainties  involved 
in  the  contract. 

Quite  often  the  amount  of  uncertainty  in  the  total  cost  is  considered 
unacceptable  by  a  decision  maker.  This  would  indicate  that  more  analysis 
is  needed  on  some  of  the  components.  The  specific  component  or  components 
causing  the  large  amount  of  uncertainty  in  the  total  cost  can  be  determined 
through  sensitivity  analysis.  An  unacceptable  total  cost  uncertainty  may  be 
the  result  of  viewing  the  results  with  a  knowledge  of  the  political  climate. 
Care  should  be  taken  not  to  "fix"  the  risk  analysis  results.  This  is  one 
piece  of  information  for  decision  making  and  not  the  decision. 

When  the  information  concerning  the  amount  of  uncertainty  is  presented, 
the  primary  drivers  should  identified.  Effectively,  one  says  how  much 
uncertainty  exists  and  why.  Actions  may  be  desired  on  the  reasons  for 
uncertainty.  Ways  of  presenting  the  total  cost  uncertainty  will  now  be 
discussed. 

At  the  time  of  negotiations  the  future  actual  cost,  since  unknown,  must 
be  estimated.  Risk  analysis  does  not  estimate  the  cost  but  rather  estimates 
its  distribution.  A  distribution  is  a  pictorial  representation  of  the  pro¬ 
babilities  of  different  final  actual  costs.  The  probability  density 
function.  Figure  4,  is  one  way  of  presenting  the  probabilities  of  different 
final  actual  costs.  This  figure  relates  area  to  probability. 
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p(x) 


Figure  4 

An  easier  way  of  presenting  this  same  information  is  to  use  the  cumula¬ 
tive  distribution  shown  in  Figure  5.  From  this  figure  one  can  determine  the 
probability  of  exceeding  a  given  total  cost  by  reading  the  Y  axis.  For 
example,  from  Figure  5  we  can  see  that  the  probability  of  exceeding  S3, 000 
is  .3.  This  would  mean  that  there  is  a  .7  probability  of  being  less  than 
S3, 000. 


Usually  from  a  risk  analysis,  two  other  pieces  of  Information  are 
available.  These  are  the  mean  and  the  mode.  The  mean  reflects  the  average 
total  cost  if  the  contract  was  executed  many  times.  Of  course,  the  contract 
Is  executed  only  once  and,  therefore,  the  mean  may  not  be  the  best  point 
estimate.  The  mode,  on  the  other  hand,  is  a  good  point  estimate  since  It 
represents  the  most  probable  total  cost.  Contrary  to  Intuition,  the  most 
probable  total  cost  Is  not  the  sum  of  the  most  probable  component  costs. 

This  can  best  be  Illustrated  by  using  a  simple  example.  Suppose  we  have  two 
loaded  dice,  where  the  "one"  Is  twice  as  likely  to  occur  as  the  2,  3,  4,  5, 
or  6.  The  analogy  Is  that  the  dice  represent  the  uncertain  components,  each 
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having  a  most  likely  value  of  1  since  each  is  loaded.  Intuition  may  tell  us 
that  the  most  likely  total  of  the  two  dice  would  be  2.  This  is  not  the  case 
however.  The  probability  of  a  2  with  these  two  dice  is  4/49,  whereas,  the 
probability  of  a  7  with  these  two  dice  Is  8/49.  The  total  of  7  Is  twice  as 
likely.  The  same  is  true  for  the  most  likely  totai  cost.  That  Is,  the 
resulting  total  cost  by  sunming  the  most  likely  values  for  each  component  is 
not  the  most  likely  total  cost. 

The  presentation  of  the  risk  analysis  results  to  convey  the  most  infor¬ 
mation  might  best  be  accomplished  using  a  display  similar  to  the  one  In 
Figure  6.  This  figure  gives  the  distribution  of  total  cost,  the  Important 
drivers,  and  the  negotiation  positions. 

The  rest  of  this  section  is  devoted  to  discussing  the  use  of  risk  analy¬ 
sis  in  structuring  contract  types.  These  results  should  not  be  considered 
rules,  but  rather  suggestions  which  may  be  helpful.  If  the  total  cost 
uncertainty^  Is  small  (e.g.,  4  percent),  then  a  Firm  Fixed  Price  (FFP)  type 
contract  would  be  appropriate.  The  price  would  be  the  most  likely  total 

cost  plus  profit  as  determined  by  the  Weighted  Guidelines  (WG). 

! 

l 

Although  incentive  contracts  were  designed  to  provide  incentives  to  the 
contractor  to  keep  the  cost  down,  they  can  also  be  structured  to  distribute 
the  risk  in  a  contract.  For  Instance,  if  the  uncertainty  in  total  costs  is 
between  4  and  16%  and  the  share  ratio  Is  40/60  ( contractor /government),  then 
the  contractor  is  only  accepting  40%  of  the  risk  or  between  1.6  and  6.4% 
reduction  in  profit.  One  might  thus  consider  structuring  a  Fixed  Price 
Incentive  Firm  (FPIF)  contract  by  using  the  following  rules  of  thumb: 

Target  Cost  *  Most  Likely  Total  Cost 

Target  Profit  ■  WG  (Including  risk) 


^When  a  single  number  is  used  to  represent  the  uncertainty.  It  Is 
usually  the  percent  that  the  99  percentile  total  cost  exceeds  the  most 
likely  total  cost. 
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gure 


Ceiling  Price  *  99  percentile  Total  Cost  Plus 
WG  (excluding  risk) 

Share  *  WG  (Including  risk)  -  WG  (excluding  risk)  x  100 
99  percentile  -  Most  Likely  Cost 

See  the  example  in  Section  V  for  structuring  an  incentive  contract. 

Of  course,  these  are  only  guidelines  and  may  be  totally  unacceptable  for 
a  particular  contract.  For  instance,  if  the  decision  has  been  made  to  use  a 
FFP  type  contract  or  specific  share  ratios  or  ceilings,  then  these  guide¬ 
lines  need  not  be  applied.  If  a  contractor  has  the  same  uncertainties  as 
the  government  (say  16<),  then  the  contractor  will  most  likely  not  consider 
a  FFP  Contract  with  a  price  equal  to  the  most  likely  cost  plus  WG  profit. 

The  contractor  would  naturally  try  to  negotiate  a  price  which  would  cover 
a  majority  of  the  risk.  It  is  important  to  note  that  the  uncertainty  in 
total  cost  might  be  totally  different  from  the  contractor's  point  of  view 
as  opposed  to  the  government's  point  of  view. 


In  summary,  the  total  cost  uncertainty  is  a  result  of  the  uncertainty 
assessed  at  the  component  level.  The  accurate  representation  of  the  total 
cost  uncertainty  and  the  reasons  for  this  uncertainty  constitute  one  input 
into  the  decision  making.  This  information  reflects  the  uncertainties 
Involved  in  a  contract  and  should  be  only  one  part  of  sound  business 
decisions.  Its  use  in  decisions  on  contract  type,  again  is  only  one  of 
many  factors  to  be  considered.  It  can,  however,  show  the  effect  of  dif¬ 
ferent  contract  types  when  uncertainties  exist. 


IV.  Assessing  Uncertain!: 


The  assessment  of  uncertainty  Is  by  far  the  most  difficult  task  in  a 
risk  analysis.  It  is  important  to  have  the  proper  perspective  of  the 
problem  when  one  is  attempting  to  develop  the  estimates  for  the  low,  most 
likely,  high  and  the  dependence  for  the  components  of  the  total  cost.  This 
perspective  Includes: 

1.  Estimates  are  for  the  actual  future  cost  and  not  the  cost  which  can 
be  negotiated.  Actual  future  cost  should  be  estimated  when  determining  a 
fair  and  reasonable  price. 

2.  Risk  Is  associated  with  uncontrollable  factors  without  regard  to 
controllable  factors  such  as  gaming,  political  climate,  etc. 

3.  Risk  analysis  Is  only  one  Input  Into  development  of  a  negotiation 
objective. 

4.  Results  of  the  risk  analysis  will  reflect  the  Inputs;  nothing  more, 
nothing  less. 

It  is  sometimes  difficult  for  a  decision  maker  on  one  side  of  a  contract 
to  relate  to  a  risk  analysis  which  Is  useful  for  determining  a  fair  and 
reasonable  price  (the  one  mentioned  above).  Therefore,  another  analysis 
viewing  the  risk  from  the  Air  Force  point  of  view  might  be  useful.  This 
analysis  would  not  attempt  to  estimate  the  future  actual  total  cost,  but 
rather  attempt  to  estimate  the  price  which  the  contractor  would  accept. 

The  two  analyses  differ  considerably  because  of  the  point  of  view.  There 
are  really  two  questions.  First,  what  Is  the  distribution  of  actual  total 
cost?  Second,  what  Is  the  distribution  of  the  resulting  negotiated  cost  at 
the  end  of  negotiations?  In  the  strictest  sense,  the  second  question  Is  not 
generally  addressed  by  a  risk  analysis,  but  can  be  answered  by  estimating 
for  each  component  the  cost  acceptable  to  the  contractor.  Even  though  the 
bottom  line  Is  the  result  of  the  negotiations,  acceptable  levels  of  each 
component  can  be  estimated.  The  discussion  In  this  section  will  address  the 
estimation  of  component  costs  when  the  distribution  of  actual  total  cost  Is 
desired. 
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Table  1  contains  a  list  of  drivers  for  the  uncertainty  involved  in  a 
contract.  This  list  is  presented  here  as  a  thought  provoker  and  is  not 
meant  to  be  all  inclusive. 

The  analyst  must  use  all  of  the  resources  available  in  order  to  estimate 
the  uncertainty  in  each  component.  These  resources  Include: 

-  historical  records 

-  experience 

-  support  groups  (engineering,  etc.) 

-  contractor's  track  record 

-  similar  contracts 

The  resulting  estimates  may  be  either  subjective  or  a  combination  of 
subjective  and  standardized  factors. 

Subjective  estimates  are  difficult  to  make  and  to  evaluate;  therefore, 
there  is  often  differing  opinions  of  the  correct  values.  When  subjective 
estimates  are  used,  try  both  a  conservative  and  a  liberal  set  of  estimates. 
This  requires  running  the  model  twice.  Many  times  you  will  find  that  the 
results  are  approximately  the  same.  A  risk  analysis  model  is  very  useful  in 
assessing  the  "What  If"  questions.  Don't  be  afraid  to  try  different  Inputs 
to  determine  the  effect  on  the  total  cost  distribution. 


Table  1 


Cost  Uncertainty  Drivers3 


Material  Elements 


Extent  of  firm  POs 

Extent  of  established  vendors 

Projected  inflation 

Reliability  of  estimated  allowance  factors 
Design  maturity 
Critical  items 


Labor  Elements 

Design  maturity/deficiencies 

Reliability  of  estimating  methodology  (L/C/ratios/estimates/LOE) 
[  Impact  of  schedule  slippages 

t  Relatable  historical  experience 

I  Employment  population 

'  Production  capacity 


Labor  and  Overhead  Rates 


Status  of  union  agreements 
Status  of  FPRA 
Projected  inflation 
Period  of  performance 
Variance  of  direct  cost  elements 
Variance  of  plant  volume 


i 


Other  Costs 


Reliability  In  estimating  methodology 
Impact  from  direct  cost  variances 
Reliability  of  factors 


3Source  -  Myron  Bailey,  ASD  Pricing 
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Assessing  the  dependence  between  component  costs  involves  listing  the 
common  cost  drivers  inherent  to  all  cost  elements,  e.g.,  design  maturity, 
manufacturing  methods,  etc.;  then  estimating  the  proportion  of  uncertainty 
between  the  low  and  high  which  Is  due  to  these  cost  drivers.  For  Instance, 
if  the  low  material  *  3000  and  the  high  material  *  7000,  and  the  common  cost 
drivers  cause  a  total  fluctuation  in  materials  of  1000,  then  the  dependence 
for  material  is  25 X  (i.e.,  1000/(7000-3000)).  Each  cost  dependence  is 
assessed  using  the  same  set  of  drivers.  See  the  list  in  Section  II  for  the 
cost  elements  for  which  dependence  is  allowed. 

A  preliminary  set  of  standardized  factors  have  been  developed  at  ASD 
Pricing.  These  factors  are  listed  in  Table  2. 

This  list  is  a  first  draft  and  should  be  modified  and  added  to  as 
needed.  Once  an  acceptable  set  of  factors  is  developed,  it  will  only  be 
necessary  for  the  analyst  to  supply  point  estimates  and  identify  the  charac¬ 
teristics  of  the  contract  as  in  Table  2.  The  computer  could  then  apply  the 
L<  and  the  to  the  component  estimates  and  perform  the  risk  analysis. 

The  decision  maker  would  then  know  specifically  the  drivers,  the  amount  of 
uncertainty  introduced  by  each,  and  the  resulting  distribution  of  total  cost. 

The  advantages  of  using  standardized  factors  are: 

1.  Uncertainty  Is  based  on  objective  characteristics  of  the  contract. 

2.  Uncertainty  becomes  less  dependent  on  the  analyst  performing  the  analys 

3.  The  amount  of  uncertainty  due  to  characteristics  of  the  contract  can 
Incorporate  different  view  points  of  analysts  and  management,  and 

4.  Uncertainty  assessment  is  consistent  between  contracts. 

An  effort  should  be  made  to  modify  and  revise  the  standardized  factors 
to  encompass  additional  reasons  for  uncertainty. 

The  next  section  demonstrates  the  use  of  a  computer  program  useful  for 
determining  the  total  cost  distribution  from  three  point  estimates  of  the 
components'  costs. 
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Draft  of  Standardized  Factors  tor  Risk  Analysis 


1. 


LX 


-5 

-5 

-5 

-8 


-5 

-5 

-5 

-8 


-5 

-5 

-5 

-10 


-5 

-5 

-6 

-9 


Material :  This  cost  element  Is  broken  Into  several  distinct  sub-elements 
due  to  their  peculiar  nature. 

H%  Score 


a.  Raw  Material; 

+7  1  -  90X  firm  purchase  orders  (POs),  established  sources 

-  2%  or  less  critical  material  (titanium,  chromium,  etc.) 

+9  2  -  80X  firm  POs;  5%  critical  material 

+12  3  -  70X  firm  POs;  10X  critical  material 

+20  4  -  60X  firm  POs;  15X  or  more  critical  material 

b.  Purchased  Parts  (Supplier  designed  items); 

+7  1  -  90X  POs 

+9  2  -  75X  POs;  25X  current  quotes 

+12  3  -  50X  POs;  25X  current  quotes,  25X  history 

+20  4  -  Less  than  50X  POs  greater  than  25X  history 

c.  Subcontracts  (Prime  designed  items): 

+7  1  -  90X  POs  and  current  quotes 

+9  2  -  75X  POs  and  quotes;  25X  engineering  estimates 

+12  3  -  Less  than  75X  POs  and  quotes;  more  than  25X  engineering  estimates 

+25  4  -  Inhouse  engineering  estimates  +  50X 

d.  Special  Material  Factors  (Scrap,  rework,  freight,  receiving  Inspections. 

attribution) ;  ~ 


+5  1  -  Historical  factors  well  supported. 

+9  2  -  Design  In  minor  state  of  flux 

+12  3  -  Design  not  set;  factors  not  reliable 

+18  4  -  New  program  with  little  relevant  history 


2.  Engineering  Labor; 

-5  +5  1  -  Firm  design  sustaining  type  effort 

•  +9  2  -  50/50  mix  of  changes  and  sustaining  effort 

-8  +15  3  -  Design  set  but  many  changes;  1st  production  phase 

-10  +25  4  -  New  program;  design  not  determined;  little  historical  basis 

to  estimates 


3.  Manufacturing  Labor: 


-2  +4  1  -  Firm  standards,  well  documented  learning  curves 

-5  +7  2  -  80X  firm  standards  less  reliable  variance  data  due  to 

limited  history 

-5  +10  3  -  1st  production  limited  standards  &  variance  data  extensive 

tooling  effort 

-7  +15  4  -  Model  shop  operation  or  RSED.  Tool  design  not  yat  determined. 


f\>  ro  ro  tnro  w 


! 


Table  2 
(continued) 


LX  HX  Score 

4.  Labor  and  Overhead  Rates; 

a.  Status  of  Union  Agreement: 

-2  +5  1  -  Firm  2-3  yrs  before  renegotiation 

-5  10  2  -  No  agreement  through  1  yr  before  expiration 

b.  Status  of  FPRA: 

+7  1  -  FPRA  negotiated 

+8  2  -  Recommended  rates  within  5X  of  proposed 

+5  3  -  Reconmended  rates  at  more  than  5X 

c.  Projected  Inflation: 

+2  1  -  Contract  includes  EPA  clause 

-15  2  -  No  EPA  -  inflation  less  than/equal  to  field  rec. 

+10  3  -  No  EPA  -  inflation  more  than  field  rec. 


d.  Period  of  Performance: 


-5 

+5 

1-1  year 

-2 

+10 

2  -  2-3  years 

-0 

+15 

3  -  4-5  years 

-0 

+20 

4  -  More  than  5  years 

5.  Considerations  That  Are  Equally  Inherent  to  All  Cost  Elements 

a.  Design: 

-2  +5  1  -  Firm  design,  mature  program 

-5  +7  2  -  2nd/3rd  production  lot  changes  predictable 

-5  +10  3  -  1st  production/pre-production 

-8  +15  4  -  Design/development  phase 

b.  Manufacturing  Methods: 

-2  +5  1  -  Standard  defined,  hard  tooling 

-5  +7  2  -  50X  standards,  production  rate  building 

-5  +10  3  -  First  production  hard  tooling  being  developed 

-8  +15  4  -  Model  shop,  FSED 


Example  Use  of  Computer  Program 


Before  presenting  an  example  of  the  usage  of  this  program,  several  input 
peculiarities  need  to  be  explained.  A  brief  explanation  is  given  below, 

1.  Overhead  rates  and  dependency  are  entered  as  whole  numbers  (e.g., 

50*  is  entered  as  50). 

2.  The  distance  between  the  low  and  the  most  likely  value  should  be 
less  than  65X  of  the  distance  between  the  low  and  high. 

(i.e.,  (ML-L)/ (H/L)  <  .65) 

3.  If  the  computer  responds  with  a  question  mark,  additional  input  is 
needed. 

4.  If  labor  is  entered  as  cost  rather  than  hours,  the  L,  ML,  and  H  for 
wage  rate  should  be  1,  1,  1. 

5.  Independence  of  component  costs  is  given  when  DX  is  0. 

6.  Conversion  to  1,000  or  1,000,000  of  dollars  and  hours  may  be  desirable. 

7.  When  dependence  Is  considered,  0%  for  material  must  be  other  than  zero. 

The  user  should  always  check  the  reasonableness  of  the  results.  If  a  problem 
Is  perceived,  the  Inputs  should  be  checked. 

Blank  forms  for  organizing  the  Inputs  and  displaying  the  results  are 
provided  In  Appendix  II.  The  input  form  has  been  completed  for  a  specific 
contract  and  Is  shown  on  the  next  page.  Form  I.  Example  1  shows  the  execu¬ 
tion  of  the  risk  analysis  program  illustrating  the  Input  and  the  output. 

All  of  the  user  supplied  input  Is  underlined. 

The  results  of  this  analysis  Indicate  that  the  most  likely  total  cost  is 
519,708  and  that  there  Is  only  a  IX  chance  of  the  total  cost  exceeding 
521,011.  The  results  of  the  computer  run  have  been  transferred  to  the  form 
for  organizing  the  results  of  the  risk  analysis  (see  Form  II). 
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INPUTS  FOR  RISK  ANALYSIS 


FORM 


Uncertainty  Primary 
Drivers 


eg  m  to 


f —  l/> 

</)  O 

O  O  o 

o  o 

O  r— 

P  4-» 

C\i  o 

o  »— 


O  H- 

^  e 


o  Uj 

*J  tA 
U  >S 
«  9)r- 

§4-»  <T3 
<0  C 
O  O  c 


CD  UJ  H* 

Su  t/> 
X  o 

O.  W  U 


FORM  11 


In  this  example  the  99  percentile  is  6%  larger  than  the  most  likely 
total  cost.  This  example  would  be  a  case  in  which  either  an  FFP  or  an  FPIF 
type  contract  might  be  used.  The  price  would  be  the  target  cost  plus  the 
weighted  guidelines  profit  for  an  FFP  contract,  where  the  target  cost  Is  set 
by  analyzing  the  results  of  the  risk  analysis.  There  is  nc  way  to  state  a 
hard  and  fast  rule  for  determining  the  target  cost;  however,  the  following 
list  of  possibilities  should  be  considered. 

1.  Target  Cost  *  $19,708 

Target  set  at  most  likely  total  cost. 

2.  Target  Cost  =  $19,774 

Target  set  so  there  is  a  50%  chance  of  over  and  under  run. 

3.  Target  Cost  =  $21,011 

Target  set  where  the  government  absorbs  99%  of  the  cost  risk. 

4.  Target  Cost  *  $18,900 

Target  set  where  the  contractor  absorbs  99%  of  the  cost  risk. 

The  setting  of  a  specific  target  would  consider  factors  not  included  in 
the  risk  analysis  but  can  be  evaluated  by  the  total  cost  distribution.  For 
instance,  if  a  target  cost  of  $20,000  is  chosen,  there  is  approximately  a 
33%  chance  that  the  total  cost  will  exceed  $20,000. 

For  an  FPIF  contract,  the  procedure  given  in  Section  III  might  be  used. 
For  example,  suppose  that  the  weighted  guideline  was  (including  risk)  16%  or 
(excluding  risk)  12%,  then  the  following  would  structure  an  incentive 
contract  so  that  the  most  probable  profit  for  the  contractor  would  be  16% 
and  there  would  be  only  a  1%  chance  of  his  having  less  than  12%  profit. 

This  Is  achieved  by  setting 

Target  Cost  *  $19,708 

WG  (excluding  risk)  =  19,708  •  .12  »  $2,365 

WG  (including  risk)  «  19,708  •  .16  »  $3,153 

Point  of  total  assumption  *  $21,011 


Target  Profit  *  $3,153 

Celling  Price  »  21,011  +  2,365  *  $23,376  (119*  of  target) 
Share  »  (3,153  -  2,365)/(21,011  -  19,708)  *  .60  or  60* 


Note  that  quite  often  this  procedure  will  come  up  with  unacceptable  results. 
Always  apply  sound  business  judgment  when  analyzing  the  results  of  these 
calculations. 
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Example  1  -  Example  Run  of  Risk  Analysis  Program 


OLD  RJSKAN 
RUN- 100 _ 

THIS  PROGRAM  WAS  WRITTEN  TO  PERFORM  THE  NECESSARY 
CALCULATIONS  FOP  A  RISK  ANALYSIS  BY  GEORGE  WORM*  1981 
THE  LINES  REQUIRING  THREE  INPUTS  ENIi  WITH  L *  ML*  H 
THE  LINES  WHICH  ALLOW  FDR  DEPENDENCE  END  WITH  L  >  ML  *  H  *  D*. 

IF  THERE  IS  NO  DEPENDENCE  ENTER  ZERO  FOP  D 
MATERIAL  COST  L*  ML >  H,  DV?S4QQ  8? 00  10000  0 

MATERIAL  OVERHEAD  INDEPENDENT  L*  ML*  H*  D?;T0  0  0  0 

MATERIAL  OVERHEAD  PATES  L*  ML*  H~5  5. £  6 

INTERS IV  TRSFPS  L.  ML*  H*  D’.~'170Q  185  0  ££Q0  0 

DIRECT  ENGPG  LABOR  < HOURS  OR  COST'*  L » ML  >  H*  P’.?  85  45  65  0 

ENGPG  WAGE  PATE  -  ENTER  ONES  IF  LABOR  IS  COST  AND  NOT  HOURS  L » ML  *  H 
711.5?  11.57  11.57 

ENGPG  OVERHEAD  INDEPENDENT  L*  ML*  H*  DV'O  0  0  0 
ENGPG  OVERHEAD  RATE’-.  L*ML*H~10£  102  108 

DIRECT  MFG  LABOR  (HOURS  OR  COST>  L*  ML*  H*  D’^800  £05  £15  0 

MGT  WAGE  PATE  'ENTER  ONES  IF  LABOR  IN  COST  AND  NOT  HOURS  L • ML • H 
•11.04  11.5  1 £  0 

MFG  OVERHEAD  INDEPENDENT  L*  ML*  H*  DV'O  0  0  0 
MFG  OVERHEAD  PATE’.  L  *  ML  *  H'150  ISO  150 
OTHER  COST*  L •  ML*  H*  D’.'4Q0  450  500  0 

G  AND  A  EXPENSE  -PERCENT  OF  SUBTOTAL- ’.  L* ML « H'4. 9£  4.*£  4.*£ 

OTHER  C  0 !  T  WITH  NO  G?  A  L  •  ML  *  H  •  D". :  0  0  0  0 
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Example  1  -  (Continued) 


estimate 

i  FDR  RISK 

flMALYS I S 

ELEMENTS 

mi  T 

MINI  MUM 

LIKELY 

h  i  mum 

DEPENPftKCI 

MATERIAL 

COST 

3400. 00 

3900. 00 

1 0000. 00 

0.  0  0 

MAT  OVERHEAD 

INDEPENDENT 

0.  00 

0.  00 

0.  00 

0.  00 

PATE  FOP  MATERIAL 

5.  00 

5.30 

3.  00 

INTEPDIV  TPSFPS 

COST 

1 7  00.  00 

1850. 00 

3300. 00 

0.  00 

DIRECT  ENGRG  LABOR 

HOURS 

2*5.  00 

45.  00 

85.  00 

0.  00 

WAGE  FmTE 

11.57 

11.57 

11.57 

ENGPG  OVERHEAD 

INDEPENDENT 

0.  00 

0.  00 

0.  00 

0.  00 

RATE  FOP  ENGP6 

1 03. 00 

1 03. 00 

1 03. 00 

DIRECT  MFf5  LABOR 

HOURS 

300. 00 

305. 00 

315. 00 

0.  00 

URGE  PATE 

1 1 .  04 

11.50 

13.  00 

MFG  OVERHEAD 

INDEPENDENT 

0.  00 

0.  00 

0.  00 

0.  0  0 

RATE  FOP  MFG 

150. 00 

150. 00 

150. 00 

OTHER  COST 

COST 

4  00.  00 

450. 00 

500. 00 

0.  0  0 

G*,A  EXPENSE 

4 . 33 

4.93 

4 . 93 

OTHER  COST  MITH  NO  6*A 

0.  00 

0 .  0  0 

0.  0  0 

0.  0  0 

PROBABILITY 

total 

OF  EXCEDI NG 

COST 

0. 0100 

2101 1.564? 

0.  0500 

20641 . 7915 

0. 1000 

20445.4526 

0.  1500 

20313.8118 

0.  2000 

20209.  9187 

0.2500 

20121.4702 

0 .  3  0  0  0 

20042.7068 

0.3500 

19970. 3938 

0.4000 

19902.4751 

0.4500 

19837.5090 

0.5000 

19774.3882 

0.  5500 

19712. 1807 

0.  6000 

19650. 0215 

0.6500 

19587. 0203 

0.  7000 

19522. 1555 

0.7500 

19454. 1206 

0. 3000 

19381 . 0381 

0. 6500 

19299.8350 

0. 9000 

19204.5029 

0.  9500 

19079. 0403 

0.  9900 

18900. 4202 

THE  MOST  LIKELY  TOTAL  COST  IS  19706.52 
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VI.  Recommendations 


Risk  analysis  can  provide  valuable  information  to  decision  makers  if 
it  is  developed  carefully  and  presented  in  a  meaningful  manner.  Several 
suggestions  are  made  here  to  facilitate  its  usefulness. 

1.  Uncertainty  Information  should  be  requested  from  engineering  and 
other  support  groups. 

2.  Several  computer  runs  would  be  useful  to  answer  the  “what  if" 
questions  and  to  analyze  the  contract  from  different  points  of  view. 

3.  Continued  development  of  standardized  factors  would  help  to  make  the 
risk  analyses  consistent  and,  therefore,  more  meaningful. 

4.  Good  business  judgment  should  be  used  when  using  the  results  of  the 
risk  analysis. 
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APPENDIX  I 


This  technical  appendix  provides  the  theory  necessary  to  perform  a 
statistical  risk  analysis  when  subcomponents*  and  total  cost  are  assumed 
to  have  a  Welbul  distribution.  The  method  used  converts  information  con¬ 
cerning  subcomponents  to  moments  of  their  corresponding  distributions  and 
combines  these  moments  to  determine  the  moments  of  the  total  cost.  By 
fitting  a  Weibul  distribution  to  the  moments  for  total  cost  probability 
statements  can  be  made  concerning  the  total  cost. 

The  appendix  is  divided  into  four  sections.  The  first  section  gives  a 
procedure  for  converting  the  user  supplied  information  listed  below  to 
moments  of  the  subcomponent  distribution: 

1.  L  -  Low  Estimate  (Probability  of  the  actual  being  lower  Is  5^) 

2.  ML  -  Most  Likely 

3.  H  -  High  estimate  (Probability  of  the  actual  being  higher  is  Sj) 

The  second  section  contains  methods  of  combining  the  moments  of  the 

subcomponents  to  obtain  the  moments  of  the  total  cost.  The  third  section 
contains  the  procedure  for  converting  from  moments  of  the  total  cost  to 
probabilities  about  the  total  cost.  In  the  last  section  a  method  of 
Incorporating  covariance  between  subcomponents  is  developed.  All  but  the 
last  section  of  the  appendix  Is  a  restatement  of  the  work  of  McNichols  [6]. 

Calculating  Moments  from  L,  ML  and  H 

In  the  risk  analysis  discussed  here  the  user  will  supply  an  estimate 
of  L,  ML  and  H  for  specific  values  of  ^  and  The  Weibul  distribution 

Is  illustrated  in  Figure  1  showing  the  relationship  between  L,  ML,  H,  5^ 
and  &2* 


I 


In  this  appendix  the  terms  subcomponent  and  component  are  used 
Interchangeably 
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Welbul  Distribution 


F(x) 


The  Welbul  distribution  with  parameters  5,  aand  c  has  a  functional  form 
given  by  F(x)  ■  c/a  ((x-5)/a)c"*  expl-ffx-O/a)^  for  x>C.  If  c,  5  and 
a  are  known  then  the  moments  are 
u  »  E(x)  »  ar(l/c+l)  +  5 

u2  *  E((x-u)2)  -  a2p(2/c+l)  -  r2(l/c+l)J  and  (A.l) 

u3  *  E( (x-u)3)  -  a3p(3/c+l)-3r(l/c+l)r(2/c+l)+2r3(l/c+l)l 

Mode  »  al(c-l)/c3^1/c)  +  £ 

The  notation  r(u)  Is  used  to  denote  the  Gairma  Function  defined  as 
r(u)  *  -V^expt-yjdy 

Table  1  gives  r(l/c+l),  r(2/c+l),  and  r(3/c+l) 
for  several  values  of  c. 

The  problem  then  Is  to  determine  c,  5  and  a  from  L,  ML,  H,  and 
These  are  found  by  using  the  cumulative  distribution  given  by 
F(x)  »  l-expC-Ux-O/a)^ 

evaluated  at  the  points  L  and  H,  and  using  the  Mode  (ML).  These  rela¬ 
tionships  are  presented  below. 

ML  «  a[(c-l)/c]1/c  +  5 
F(L)  *  l-exp[-(L-C)/a)c  * 
or  L  »  a[-ln(l-fii)]  /C  ♦  C 

F(H)  •  l-exp[-(H-£)/a)C]  «  l-«2 
or  H  «  a[-ln(62)]1/C  +  £ 
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TABLE  I 


c 

r(i/c+i) 

r(2/C+l) 

r(3/c+i) 

1.010 

.99585 

1.96394 

5.78098 

1.020 

.99187 

1.92951 

5.57543 

1.030 

.98803 

1.89662 

5.38215 

1.040 

.98435 

1.86518 

5.20043 

1.050 

.98080 

1.83506 

5.02920 

1.060 

. 97738 

1.80626 

4.86768 

1.070 

.97409 

1 . 77864 

4.71529 

1 .080 

.97092 

1.75218 

4.57126 

1.090 

.96786 

1 . 72781 

4.43503 

1.100 

.96490 

1 . 70245 

4.30606 

1.110 

.96208 

1.67904 

4.18387 

1.120 

.95935 

1.65657 

4.06794 

1.130 

.95671 

1.63494 

3.95796 

1.140 

.95416 

1.61416 

3.85337 

1.150 

.95170 

1.59416 

3.75398 

1.1  SO 

.94934 

1.57490 

3.65940 

1.170 

.94706 

1 . 55633 

3.56932 

1.180 

.94485 

1 . 53846 

3.48345 

1.190 

.94271 

1.52121 

3.40154 

1.200 

. 94066 

1 . 50459 

3.32336 

1.210 

. 93868 

1.48854 

3.24871 

1.220 

.93676 

1.47303 

3.17733 

1.230 

.93491 

1.45807 

3.10908 

1.240 

.93312 

1.44361 

3.04378 

1.250 

.  931 38 

1.42963 

2.98119 

1.260 

.92972 

1.41612 

2.92129 

1.270 

.92811 

1.40305 

2.86381 

1.280 

.92655 

1.39039 

2.80882 

1.290 

.92504 

1.37814 

2.75578 

1.300 

.92358 

1.36629 

2.70493 

1.310 

.92217 

1.35480 

2.65607 

1.320 

.92081 

1.34367 

2.60913 

1.330 

. 91 949 

1.33288 

2.56397 

1.340 

.91823 

1.32242 

2.52047 

1.350 

.  91 700 

1.31227 

2.47863 

1.360 

.91581 

1.30241 

2.43831 

1.370 

.91464 

1.29285 

2.39939 

1.380 

.91354 

1.28357 

2.36196 

1.390 

.91 246 

1.27457 

2.32578 

1.400 

.91143 

1 . 26584 

2.29091 

1 .410 

.91042 

1.25734 

2.25721 

1.420 

.90946 

1.24907 

2.22466 

1.430 

.90851 

1 . 241 04 

2.19322 

1.440 

.90761 

1.23323 

2.16284 

1.450 

.90672 

1.22565 

2.13341 

1 .460 

.90588 

1.21825 

2.10500 
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TABLE  I 
(Continued) 


c 

r(l/C+l) 

r(2/c+i) 

r(3/C+l) 

1.470 

.90505 

1.21106 

2.07746 

1.480 

.90426 

1.20408 

2.05084 

1.490 

.90349 

1 . 1 9734 

2.02504 

1.500 

.90276 

1.19068 

2.00000 

1.510 

.90204 

1.18420 

1.97579 

1.520 

.90134 

1 . 1 7791 

1 . 95230 

1.530 

.90068 

1.17178 

1 . 92951 

1.540 

.90002 

1.16581 

1.90742 

1.550 

.89940 

1.15999 

1.88599 

1.560 

.89879 

1.15433 

1.86518 

1.570 

.89821 

1.14880 

1.84491 

1.580 

.89765 

1.14341 

1.82533 

1.590 

.89710 

1.13815 

1.80626 

1.600 

.89658 

1.13300 

1 . 78773 

1.700 

.89225 

1.08797 

1.62793 

1.800 

.88930 

1.05219 

1 . 50459 

1.900 

.88737 

1 .02342 

1 .40735 

2.000 

.88623 

1 .00000 

1.32934 

2.100 

.88570 

.98080 

1 .26584 

2.200 

.88563 

.96490 

1.21345 

2.3C0 

.88593 

.95170 

1.16978 

2.400 

.88649 

.94066 

1.13300 

2.500 

.88726 

.93138 

1.10180 

2.600 

.88822 

.92358 

1.07515 

2.700 

.88928 

.91 700 

1.05219 

2.800 

.89046 

.91143 

1.03234 

2.900 

.891 73 

.90672 

1.01509 

3.000 

.89301 

.90276 

1.00000 

3.100 

.89431 

.89940 

.98679 

3.200 

.89566 

.89658 

.97518 

3.300 

.89702 

.89422 

.96490 

3.400 

.89839 

.89225 

.95585 

3.500 

.89976 

.89062 

.94781 
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Note  that 


Mt-L  ■  r(c-l)/cl'/c  - 

TL  .  [-i„(,-5^)]l/c 

which  is  always  between  0  and  1  and  is  a  function  of  c.  Furthermore,  the 
left  hand  side  can  be  calculated  from  estimates.  To  solve  for  c,  a  table 
has  been  constructed  (see  Table  II)  for  determining  c  given  (ML-L)/(H-L) . 

The  difference  between  H  and  L  can  be  used  to  solve  for  a  and  yields 

a  =  _  H-L _ 

[-ln(52)]l/c  -  [-lnd-6!)]1^  (A.2) 

And  from  the  equation  for  ML,  we  have 

£  *  ML-a[(c-l)/c]1/c  (A,3) 

In  sumnary,  the  steps  for  finding  the  moments  of  the  subcomponents  are 

Step  1:  Estimate  L,  ML  and  H  for  a  given  and  S2 
Step  2:  Find  c  from  Table  II  using  (ML-L)/(H-L) 

Step  3:  Calculate  a  and  ?  using  (A.2)  and  (A. 3) 

Step  4:  Calculate  u,  u2  and  u3  using  (A.l) 

Calculating  Moments  of  Products  and  Sums 

The  total  cost  is  the  product  and  sum  of  subcomponents.  The  moments  of 
the  total  cost  can  be  determined  by  using  what  are  called  additive  and 
multiplicative  moments.  The  only  assumption  needed  is  that  the  subcom¬ 
ponents  are  independent.  This  assumption  can  be  relaxed  using  the  results 
in  section  four. 

When  two  subcomponents  are  added  the  moments  of  their  total  are  the  sum 
of  the  moments  for  each  subcomponent.  That  is 

ufX^+Xj)  a  u(X^)  +  uUj) 
u2(X^+X2)  *  u2(Xj)  +  u2(X2)  and 

u3(Xi+X2)  *  y 3 ( X ^ )  +  u3(X2) , 

where  uj(X)  denotes  the  jth  moment  of  X  about  the  mean.  Note  that  this  is 
only  true  for  the  first  three  moments  and  for  variables  which  are  independent. 
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TABLE  II 


(ML-L)/ (H-L ) 


.01 

1 .05014 

.02 

1 .08514 

.03 

1 .11 767 

.04 

1.14869 

.05 

1.1  7873 

.06 

1 .20814 

.07 

1  .2371  7 

.08 

1.26598 

.09 

1  .29472 

.10 

1.32349 

.11 

1.35239 

.12 

1.38150 

.13 

1 .41089 

.14 

1.44063 

.15 

1.47079 

.16 

1 . 50142 

.17 

1.53258 

.18 

1 .56434 

.19 

1.59675 

.20 

1.62986 

.21 

1.66375 

.22 

1  .69847 

.23 

1.73409 

.24 

1 . 77068 

.25 

1 .80831 

.26 

1 .84706 

.27 

1 .88701 

.28 

1.92824 

.29 

1.97086 

.30 

2.01497 

.31 

2.06065 

.32 

2.10806 

.33 

2.1 5730 

.34 

2.20852 

.35 

2.26188 

.36 

2.31 754 

.37 

2.37569 

.38 

2.43653 

.39 

2.50029 

.40 

2.56723 

.41 

2.63763 

.42 

2.71179 

.43 

2.79008 

.44 

2.87290 

.45 

2.96069 

.46 

3.05397 

.47 

3.1 5332 

.48 

3.25941 

TABLE  I  I 
(Continued ) 


(ML-L )/ (H-L ) 


.49  3 

.50  3 

.51  3 

.52  3 

.53  3 

.54  4 

.  55  4 

.  56  4 

.57  4 

.58  4 

.59  5 

.60  5 

.61  5 

.62  6 

.63  6 

.64  7 

.65  8 


C 


.37303 
.49505 
.626 
.769 
.923 
.091 
.275 
.473 
.  702 
.95 
.23 
.544 
.901 
.31  2 
.79 
.352 
.025 
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When  two  subcomponents  are  multiplied  the  moments  of  the  product  are  not 
the  product  of  the  moments  of  the  subcomponents.  However,  if  we  define 
M^,  and  as  the  moments  about  the  origin,  then 

M1(X1X2)  *  KjfXj)  Mj(X2) 

M2(X1X2)  *  H2(X1)  M2(X2)  and  (A. 4) 

m3(x1x2)  *  m3(x1)  m3(x2) 

These  moments  about  the  origin  are  related  to  the  additive  moments  by 
the  relationships  given  below 

Ml*Ul  2 

M2*u2  +  ui  3  (A. 5) 

Hj*U3  +3UiU2*Ui 
or 

u  i 

(A. 6) 

u  3  *M3 -3M jM2+2Mj  ^ 

Therefore,  If  two  subcomponents  are  multiplied,  the  moments  about  the 
mean  of  the  product  U|(XjX2)  can  be  found  by 

Step  1:  Determine  u.(X^)  and  u1(X2),  i  *  1,  2,  3 

Step  2:  Find  M^(X^)  and  M^(X2),  i  s  1,  2,  3  using  (A. 5) 

Step  3:  Find  Mi(XjX2),  1  *  1,  2,  3  using  (A. 4)  and 

Step  4:  Find  u^XjXg),  i  *  1,  2,  3  using  (A.6). 

Note  that  we  start  with  u^(X^)  and  u1(X2)  and  end  up  with  wj(X,X2). 

To  illustrate  the  application  of  the  method  of  moments  for  determining 
the  moments  of  the  total  cost  a  simple  example  will  be  used.  Consider  the 
total  cost  equation 

Total  cost  •  VX2X3+X4X5X6* 

where  X^...,  Xg  are  six  subcomponents  with  estimates  of  L,  ML,  and  H.  First 
we  flndu^(Xj)  1*1, 2, 3  and  j*l,2,...,6. 

Second,  we  use  (A.5),  (A. 4)  and  (A.6)  to  find  u  1(X2X3),  u^X^Xg)  and 

w1(X4XsV  and  f1nally 

u  ^ (Total  cost)  •  u,(X)  +  y^XgX-j)  +  u^X^XgXg). 

Note  that  u^X^Xg)  is  not  needed  If  one  calculates  M^(X4^5Xg)  as 
M1(X4)  M1(Xg)  M1 ( Xg) . 

The  moments  of  the  total  cost  can  thus  be  obtained  by  applying  the  pro¬ 
cedure  outlined  In  this  section.  Next  we  will  show  how  to  estimate  a  Welbul 
distribution  having  the  moments  of  the  total  cost  and  then  how  probabilities 
can  be  calculated. 
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Calculating  Probabilities  About  Total  Cost 

If  the  first  three  moments  of  the  total  cost  are  known,  and  we  wish  to 
make  probability  statements  concerning  the  total  cost,  it  is  necessary  to 
assume  a  distribution  for  the  total  cost.  Since  the  total  cost  distribution 
is  generally  positively  skewed,  the  Welbul  will  again  be  used.  First,  a  set 
of  parameters  u»  c  and  5  which  give  a  Weibul  distribution  with  approximately 
the  same  moments  are  determined. 

From  (A.l)  we  can  see  that 

G(c)  =  (n3)*  =  [r(3/c+l  )-3T(i/c+l  K(2/c+l  )+2T3(l/c+l )12 

(V2)  [r(2/c+l )-r2(l/c+l)]3 

is  a  function  of  only  c  and  the  left  hand  side  can  be  calculated  for  the 
total  cost  moments.  Table  III  gives  the  G(c)  for  different  values  of  c. 
Using  this  table  and  the  calculated  value  of  (113)  /(  U2)  'for  the  total 
cost,  an  appropriate  value  of  c  can  be  determined.  Then  using  the  equation 
for  u2  and  (A.l)  and  the  calculated  values  of  y2  and  **; ,  a  and  5  are 

C.  •  Cv2/(r(2/c+l)-r2(i/c+l))]1/2 
r  =  Ul-ar(l/c+l) 

Now  that  c,  a  and  scan  be  determined  from  ulf  y2  and  u3,  the  following 
can  be  calculated 

Mode  of  Total  Cost  *  a[(c-l  )/c]1/cn 

Probability  (Total  Cost  >  X)  *  exp  [-((X-5)/a)c  ] 

Total  cost  for  which  there  Is  a  5  probability  of  exceeding  is 
a[-ln(6)]1/c+C 

Being  able  to  make  these  probability  statements  would  be  the  completion  of 
the  risk  analysis.  It  is  important  to  note  the  assumptions  made  in  order  to 
use  the  analysis  in  the  first  three  sections.  They  are 

Assumption  1:  Subcomponents  have  a  Welbul  distribution 

Assumption  2:  Total  cost  has  a  Weibul  distribution 

Assumption  3:  Subcomponents  are  Independent 

The  purpose  of  the  next  section  is  to  relax  assumption  3  by  structuring  the 
dependence  of  the  subcomponents  and  to  Illustrate  how  this  can  be  incor¬ 
porated  in  the  above  analysis. 
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TABLE  III 


/V2  C 


— Tfl - 

3.60 

.  1 

2.60026 

.2 

2 .31 480 

.3 

2.1 3207 

.4 

1 .98141 

.  5 

1 .89207 

.6 

1 .80521 

.  7 

1  . 731 58 

.8 

1 .66832 

.9 

1 .61 292 

I  .0 

1 .56380 

1.1 

1 .51 994 

1  .2 

1 .48046 

1.3 

1.44440 

1.4 

1  .41128 

1  .  5 

1.381 20 

1  .6 

1 .35301 

1.7 

1 .32690 

1  .8 

1  .30265 

1.9 

1.28026 

2.0 

1 .25884 

2.1 

1  .23894 

2.2 

1  .  2201  5 

2.3 

1.20237 

2.4 

1.18563 

2.5 

1  .16975 

2.6 

1  .1  5458 

2.  7 

1.14014 

2.8 

1.12652 

2.9 

1.11338 

3.0 

1.10074 

3.1 

1.08884 

3.2 

1  .07742 

3.3 

1 .06639 

3.4 

1.05580 

3.5 

1  .04562 

3.6 

1.03579 

3.7 

1.02637 

3.8 

1.01 730 

3.9 

1  .00849 

4.0 

1  .00000 
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Covariance  Between  Subcomponents 

Historically,  risk  analysis  has  assumed  that  the  subcomponents  of  total 
cost  were  independent.  This  assumption  was  made  because  of  two  basic  reasons. 
First,  the  user  of  the  models  could  not  estimate  the  covariance  because  of 
the  lack  of  historical  data  and  (or)  the  lack  of  a  way  of  capturing  the 
covariance  from  subjective  estimates.  Covariance  is  a  relative  figure  which 
has  no  intuitive  interpretation  of  its  magnitude.  A  covariance  of  say  50  is 
meaningless  unless  it  is  compared  with  another  covariance  or  variance. 

The  second  reason  covariance  (lack  of  independence)  has  been  assumed 
away  is  because  of  the  difficulty  of  incorporating  It  into  the  risk 
analysis.  To  incorporate  it  into  most  risk  analysis  procedures  would 
require  an  assumption  about  the  multivariate  distribution.  Even  then 
complications  arise  as  to  how  to  combine  these  distributions  in  order  to 
obtain  the  distribution  of  the  total  cost. 

The  purpose  of  this  section  Is  to  propose  a  means  of  structuring  the 
covariance  between  subcomponents  and  a  means  of  posing  questions  to  the  user 
in  such  a  way  that  the  covariance  takes  on  an  intuitive  meaning.  Finally,  a 
means  of  incorporating  this  covariance  information  into  the  total  cost 
distribution  is  given.  Conceptually,  the  user  is  asked  to  estimate  for 
each  subcomponent  a  proportion  of  the  total  variation  due  to  a  commonality 
between  the  subcomponents.  See  the  example  below  for  a  discussion  of  how 
this  can  be  done.  This  information  is  used  to  break  the  variance  of  the 
subcomponent  Into  two  parts.  Each  subcomponent  is  considered  to  be  the  sum 
of  two  Independent  random  variables,  one  of  the  two  being  a  part  of  another 
subcomponent.  Putting  these  two  random  variables  Into  the  cost  model  in 
place  of  the  subcomponent  makes  the  total  cost  a  function  of  independent 
random  variables.  The  methods  discussed  in  sections  two  and  three  would 
then  be  applicable. 

The  structure  to  be  placed  on  the  subcomponents  is  that  each  subcom¬ 
ponent  X.|  Is  of  the  form 

X.  «  ^  +  «lD, 

where  1^  is  a  random  variable  which  represents  the  Independent  variation  of 
subcomponent  X^  and  where  D  Is  a  random  variable  which  is  common  to  other 
subcomponents.  a^D  will  be  referred  to  as  the  dependent  portion  of  subcom¬ 
ponent  Xj. 


39 


The  user  is  asked  to  supply  the  proportion  of  the  total  variation  in 
each  X.  which  Is  being  caused  by  the  exogenous  events  or  factors  consti¬ 
tuting  the  corononallty  between  the  subcomponents.  In  other  words,  part  of 
the  variation  in  each  is  thought  to  have  some  common  reason  for  occurring. 
For  instance,  labor  cost  and  material  cost  may  both  be  high  because  of 
excessive  rework.  Here  excessive  rework  would  be  the  commonality.  In  this 
example,  suppose  that  the  low  and  high  for  labor  cost  and  material  cost  were 
($5,000,  $10,000)  and  ($25,000,  $50,000)  respectively.  Now  If  the  labor 
cost  were  to  fluctuate  by  $2,000  because  of  excessively  high  or  low  rework 
and  material  cost  were  to  fluctuate  by  $5,000  because  of  rework,  the  user 
would  say  that  40<  (l.e.,  2,000/(10,000-5,000))  of  labor  cost  and  20JC  (i.e., 
5,000/(50,000-25,000))  of  material  cost  were  dependent  on  rework.  The  rest 
of  the  variation  in  labor  and  material  cost  would  be  considered  independent. 

The  commonality  between  subcomponents  will,  in  general,  consist  of  more 
than  one  factor  and  their  effect  on  subcomponents  should  be  estimated 
cumulatively. 

The  proportion  of  the  total  variation  of  subcomponent  X^  due  to  a  common 
dependence  will  be  denoted  by  P^.  Since  represents  the  proportion  of  the 
total  variation  represented  by  a^D,  the  standard  deviation  of  a^O  should  be 
approximately  .  The  variance  of  is  the  sum  of  the  variance 

of  1^  and  a^D;  therefore,  the  variance  of  1^  is  given  as 

i^dj)  *  ug(X^)  -  v«2 (ci iD ) 
or 

-  (1-P12)w2(X1)  (A. 7) 

By  taking  *  1 

u2(0)  *  P^fXj)  (A.B) 

and  for  1*2,  .  .  .,  n 

u2(<* jD)  «  ai2u2(D)  •  Pi2»2(Xi) 
or 

(A. 9) 

The  results  can  now  be  summarized  for  finding  u2(0),  u2(Ij),  from  u2(X<) 
and  Pj. 
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Step  1:  Use  section  1  to  estimate  ^(X^)  and  estimate  Pj. 

Step  2:  Calculate  UgOj)  using  (A. 7). 

Step  3:  Calculate  i^0)  using  (A. 8). 

Step  4:  aj  *  1  and  calculate  using  (A. 9). 

For  the  above  analysis  It  Is  necessary  to  assume  that  Pj  7*0,  Uj(D)  *  0, 
»3(D)  *  0,  ^(X^)  A  0.  In  the  event  *  0  or  »2(X^)  *  0  it  Is  only  necessary 

to  redefine  Xj  to  be  a  subcomponent  for  which  P^  t  0  and  Vg(Xj)  f  0* 

Returning  to  our  example  using  labor  cost  (Xj)  and  material  cost  (Xj), 
suppose  the  variances  were 

*  1,000,000 

u2(X2)  *  25,000,000 


then  for 


W 

“2(‘2> 

«-(0) 


.4  and  P2  *  .2 
(1-.16)  1,000,000 
(1~. 04)25, 000, 000 
.16(1,000,000) 


.2/. 4  \/25, 000, 000/1, 000, 000 


and  X2  we  would  use  instead  Ij  +  D  and  Ij  + 


1’ 


I2  and  D  would  be  independent  and  have  moments 


In  a  cost  model  with  Xj 
The  three  random  variables  I 

U1(I1)  *  ui<xi)*  ^l)  3  U3(X1*’  W3(I2)  •  w3(X2),  ^(0)  -  0 

Uj(D)  *  0  and  (^(l^)*  ^(^K  UgfD))  as  ca^cu^atecl  above. 

Now  that  the  moments  of  1^  and  D,  and  0^  can  be  determined,  we  now  look 
at  how  they  can  be  combined  into  the  moments  of  the  total  cost. 

The  cost  model  used  here  is 

I Xj (l+Xj)+X2+X^+XgXg(l+Xg)+X^+XgX2Q( I+Xj^^Xjj+X^)  (1+Xi4)+Xi5 


where 

Xj  *  Material  Cost, 

X2  *  Material  Overhead  (not  based  on  Material  Cost), 

Xj  ■  Material  Overhead  Rate, 

X^  «  Interdivlslonal  Transfer  Cost, 

Xg  *  Engineering  Hours, 

Xg  *  Engineering  Wage  Rate, 

Xy  *  Engineering  Overhead  (not  based  on  Engineering  Cost), 
Xg  «  Engineering  Overhead  Rate, 
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Xg  *  Manufacturing  Hours, 

Xjg  «  Manufacturing  Wage  Rate, 

X^  *  Manufacturing  Overhead  (not  based  on  Manufacturing  Cost), 

X^2  *  Manufacturing  Overhead  Rate, 

X^  *  Other  Cost, 

X14  *  General  and  Administrative  Expenses,  and 
Xjg  *  Other  Cost  with  no  G&A  Expenses 

In  this  model  Xj,  X2,  X4,  Xg,  X?,  Xg,  Xn,  X13  and  X15  will  be  allowed 
to  have  covariance.  The  resulting  model  when  X^  Is  replaced  by  1^  +  ^o  is 
1{I1(1+X3)+I2+I4+I5X6(1+X8)+I7+I9X10(UX12)+IU+I13>(1+X14)+I15J+ 

V °! ( 1+X3 )+ V °4+a5X6( 1+X8 ,+a7+°9X10( 1+X12 ,+all+a13 }(1+X14)+Ct153 0 

For  notatlonal  purposes  this  will  be  written  as 
Aj+A2D. 

Observe  that  using  additive  and  multiplicative  moments  the  first  three 
moments  of  A^  and  A2  can  be  determined.  But  Aj  and  Ag  are  not  independent. 
The  first  two  additive  moments  of  Aj+A2D  are  given  by 

VA1+A2D^  * 

UgfAj+AgD)  »  u2(A1)+u2(A2)u2(0)+u12(A2)u2(0)  (A. 10) 

Therefore,  the  first  two  moments  of  the  total  cost  can  be  determined. 

The  third  moment  of  the  total  cost  Is 

^(Aj+AgD)  *  u3(ai )  "3  Uj(A1)u1(A^)ji2(D)+3  UjCAjA^u^D)  (A. 11) 

2 

where  all  of  the  terms  are  known  except  for  UjCAjAg)  which  Is 
u1^A1A2^  “  ul^clC2^  Ul^1+X14^+  ul(cl)ul^1+x14^al5 

+2ai5Ui(cic2)ui((l+Xi4)2)+Ui(c2)ui((l+Xi4)2)(uiIi5) 

+a15U1^15^+2°l15ul^C2^wl^+X14^u1^15^  (A.  12) 

where 

C1  *  (I2+I4+I7+I11+I13)+I1{1+X3)+I5X6(1+X8)+I9X10(1+X12) 


c2  "  (a2+o4+c,7+all+c‘l3^'fol^1+X3^+a5X6^1+X8^+a9X10^1+X12^ 


The  terms  ^(c^)  and  u^c^c^)  are  given  by 

ul(clc2}  *  g  aiVl(*lV 

U1  (clc25  *  fjk  a1bjblcul^y1yjylc) 
where 

al  *  W1^I2+I4+I7+111+I13^’ 
a2  * 

a3  *  W1(I5,‘ 

a4  *  ul^  Jg) » 

bl  =  a2+a4+a7+all+a13* 
b2  =  Bl* 
b3  3  a5* 
b4  3  a9*  ' 

yl  3  *• 

y2  =  (i+x3), 

y3  -  Xg(l+Xg),  and 
y4  3  X10(1+X12}‘ 

The  term  u , (y.y.y.  )  must  be  evaluated  differently  when  i*j,  1*k,  j«k  and 
i*j*k.  1  1  3  K 

In  summary  the  first  three  moments  of  total  cost  can  be  found  by  using 
equations  (A. 10)  through  (A. 13)  and  the  procedures  given  in  the  first 
three  sections  of  this  appendix. 
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APPENOIX  II 


Forms  for  Organizing  Inputs  and 
Displaying  Outputs  of  Risk  Analysis 
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